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IMAGE PROCESSOR FOR DETECTING SPECIFIED PATTERN 



This application is based on applications Nos. 
2000-129762 and 2000-129763 filed in Japan, the contents of 

5 which are hereby incorporated by reference. 



BACKGROUND OF THE INVENTION 
FIELD OF THE INVENTION 

The present invention relates to image processing 

10 for detecting a specified pattern in an image. 
DESCRIPTION OF PRIOR ART 

Recently, a color copying machine provides many 
functions with improved performance, and counterfeit on 
paper money, securities or the like becomes a big problem. 

15 Then, effective countermeasures for preventing counterfeit 
have been researched. In one of the countermeasures, 
specified patterns have been embedded in a design in a paper 
money or the like. When an image scanned is read in copying 
operation in a copying machine, the scanned image is 

20 analyzed, and when a specified pattern is detected in the 
image, normal image forming is forbidden. 

When a paper money or the like is scanned, it has 
to be detected from the scanned image even when the paper 
money or the like is put in an arbitrary position on the 

25 scanner or even when it has stains, damages or the like 
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locally. 

Most of the input data received from an input 
device such as a scanner are color image having many data. 
Further, there is a tendency that the input and output 
5 devices can deal an image at higher speed and at higher 
resolution. However, real time image processing or 
detection of specified patterns is required in order to 
prevent counterfeit. Then, it is an important problem to 
develop a technique of image detection at high speed even 

10 in the presence of noises. 

When an image is read with a scanner, the color of 
the read image is changed with scan conditions. Further, 
input image data are affected by deterioration of the 
scanner, change in environmental conditions, change in 

15 stress conditions or the like. Therefore, in order to 
detect a specified image, it is needed to widen the range of 
color of the specified image to be detected. On the other 
hand, the widening of color range is a factor which 
increases noises and detection errors. 

20 

SUMMARY OF THE INVENTION 

An object of the present invention is to perform 
image processing for detecting a specified color at a higher 
precision. 

2 5 In one aspect of the invention, in an image 
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processor, a first decision controller decides whether input 
color data of a target pixel exist in first ranges, and a 
second decision controller decides whether differences 
between color data of the target pixel and those of pixels 
5 adjacent thereto exist in second ranges different from the 
first ranges. Then, a color decision controller decides 
that the target pixel has a specified color when the color 
data of the pixel are decided to exist in the first ranges 
and the differences are decided to exist in the second 
10 ranges. 

In another aspect of the invention, in an image 
processor, a first decision controller decides whether input 
color data of a target pixel exist in first ranges, and a 
second decision controller performs calculation on the input 

15 color data of the target pixel and decides whether results 
of the calculation exist in second ranges different from the 
first ranges. Then, a color decision controller decides 
that the target pixel has a specified color when the color 
data of the pixel are decided to exist in the first ranges 

20 and the differences are decided to exist in the second 
ranges . 

An advantage of the present invention is that a 
specified color in a specified pattern can be detected even 
when the input image data are affected by external factors. 
2 5 Another advantage of the present invention is that 
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errors in color detection can be decreased by narrowing the 
color detection ranges with use of different types of 
conditions . 

5 BRIEF DESCRIPTION OF THE DRAWINGS 

These and other objects and features of the 
present invention will become clear from the following 
description taken in conjunction with the preferred 
embodiments thereof with reference to the accompanying 
10 drawings, and in which: 

Fig. 1 is a diagram of an image processor 
according to a first embodiment of the invention; 

Fig. 2 is a schematic block diagram of a part of 
the image processor including a controller thereof; 
15 Fig. 3 is a flowchart of detection of a specified 

pattern in a first embodiment of the invention; 

Fig. 4 is a flowchart of detection of a specified 

color; 

Fig. 5 is a flowchart of first decision; 
20 Fig. 6 is a flowchart of second decision; 

Fig. 7 is a diagram for illustrating an example of 
color decision; 

Fig. 8 is a flowchart of second decision according 
to a second embodiment of the invention; 
25 Fig. 9 is a diagram for illustrating an example of 
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color decision in R and G space; and 

Fig. 10 is a diagram for illustrating another 
example of color decision in R and G space. 

5 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Referring now to the drawings, wherein like 
reference characters designate like or corresponding parts 
throughout the several views, Fig. 1 shows an image 
processor (hereinafter referred to as system) according to a 

10 first embodiment of the invention schematically. The system 
has a controller 10 which has a central processing unit 
(hereinafter referred to as CPU) to control the entire 
system. The controller 10 has a display device 12 for 
displaying images, characters or the like, and a keyboard 14 

15 and a mouse 16 provided for inputting data and instructions. 
A flexible disk 18, a hard disk (not shown) and a CD-ROM 26 
are used as recording media, and a flexible disk drive 18b, 
a CD-ROM drive 2 6b and a hard disk drive 20 are provided 
therefor. Further, the controller 10 is connected to a 

2 0 printer 22 for printing text data, an image or the like, a 
scanner 24 for acquiring image data, a speaker 28 for 
generating sound, and a microphone 30 for receiving sound. 

Fig. 2 shows a structure of the controller 10. 
The CPU 200 is connected via a data bus 202 to a read only 

25 memory (ROM) 204 for storing a program to control the system 
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or the like, and to a random access memory 206 for storing 
the program or the like temporarily used by the CPU 200. 
Further, CPU 2 00 is connected via the data bus 202 to a 
display controller 208 for displaying images or characters 
5 in the display device 12, to a keyboard controller 210 for 
transmitting key- inputs from the keyboard 14, to a mouse 
controller 212 for transmitting input signal from the mouse 
16, to a flexible disk drive controller 214 for accessing 
the flexible disk drive 18b, to a hard disk drive controller 

10 216 for accessing the hard disk drive 20, to a printer 
controller 218 for controlling the printer 22, to a scanner 
controller 220 for controlling the scanner 24, to a CD-ROM 
controller 222 for controlling the CD-ROM drive 26b, to a 
speaker controller 224 for controlling the speaker 28 and to 

15 a microphone controller 226 for controlling the microphone 
30, Further, the CPU 200 is connected to a clock circuit 
228 for generating reference clock signals for operating the 
system, and it has an extension slot 230 for connecting an 
extension board. 

20 In this system, a program for image processing is 

stored in a recording medium such as the ROM 204. However, 
the program or a part thereof may be stored in a recording 
medium such as a flexible disk 18, a hard disk 20 or a CD- 
ROM 26. When necessary, it is read therefrom and written to 

25 the RAM 206, A magneto-optical disk or the like may also be 
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used as a storage medium. The scanner 24 is used as a 
device for inputting image data, but a different data input 
device such as a still video camera or a digital camera may 
also be used. Further, by connecting a network board to the 
5 extension slot 230, a program or an image data may be 
received through a network. 

The image processor decides whether the input 
image includes a specified pattern having a plurality of 
small elements arranged to have a predetermined position 

10 relationship between them. Fig. 3 shows a flowchart of the 
detection of the specified pattern. First, image data 
having a plurality of color data for each pixel is received 
from an image input device such as a scanner (S10) . Next, 
it is decided whether pixels in the input image data have 

15 the specified color (S12) . Then, based on the result of 
color decision, small elements having the predetermined 
pattern are extracted, and a center thereof is determined 
(S14) . Finally, it is discriminated whether a center of the 
small elements is arranged at a specified position (S16) . 

20 Thus, the specified pattern is detected in the input image. 

When the scanner 24 reads an image, the color of 
the read image is affected with scan conditions. Similarly, 
an image may vary with environment conditions or stress 
conditions. Therefore, in order to detect a specified image, 

25 it is necessary to widen the detection range of colors by a 
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color decision means. However, the widening of the decision 
range is liable to increase noise components and to generate 
detection errors. Then, in order to widen the detection 
range of colors without increasing detection errors, it is 
5 checked not only whether the gradation values of R, G, B of 
a pixel exist in predetermined first ranges to define the 
specified color, but it is also checked whether differences 
of the gradation values of R, G, B from those of adjacent 
pixels exist in predetermined second ranges. When the 

10 conditions on the first and second ranges are satisfied, the 
pixel is decided to have the specified color. Thus, by 
including the condition of gradation differences relative to 
adjacent pixels, differences due to deterioration of the 
scanner, change in environmental conditions or stress 

15 conditions can be decreased. 

Fig. 4 shows a flowchart of the decision whether 
pixels in the input image data have the specified color (S12 
in Fig. 3) . First, color image data having color 
components of red (R) , green (G) and blue (B) is received 

20 for the detection (S100) . The image data are decided by 
the first decision means to be in first predetermined color 
ranges or not (S102) , in order to detect the specified 
color. Practically, in a flowchart of the first decision 
means shown in Fig. 5, maximum values of Rmax, Gmax and B 

25 max and minimum values, Rmin, Gmin, and Bmin of R, G and 
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B have been determined beforehand, and a variable, i, for 
representing a pixel is initialized to one (S1020) . The 
variable, i, has a value of 1, 2, . n. Next, it is 
decided whether input image data of i-th pixel satisfy 
5 following conditions of color range (S1022) . 

Rmin < Ri ^ Rmax, 

Gmin < Gi ^ Gmax, (D 

and 

Bmin ^ Bi ^ Bmax . 

10 Only if these conditions are satisfied, the pixel is 
decided as a specified color candidate (S1024) . A pixel 
decided as a specified color candidate is denoted as an on- 
pixel, while a pixel not decided as a specified color 
candidate is denoted as an off-pixel. Thus, binarization 

15 is performed. Next, i is incremented (S1026), and if the 
data processing have not been completed on all the pixels 
(NO at step S1028), the flow returns to step S1022 to 
repeat the above-mentioned processing. 

Returning to Fig. 4, input image is decided by a 

20 second decision means (S104) . If the color decision is 
performed only by using the maxima and minima of R, G and B, 
as in the above-mentioned first decision means (S102), a 
color (noise) different clearly for the color to be 
detected is liable to be detected. Then, in order to 

25 remove the noise, the second decision means is used. For 
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example, in order to decide whether the pixel has the color 
to be detected, gradation differences from R, G and B data 
of adjacent pixels are obtained, and the color ranges are 
defined on the gradation difference. Practically, in a 
5 flowchart of the second decision means shown in Fig. 6, 
maximum values of d R max, d G max and d B max and minimum 
values, dRmin, dGmin, and dBmin of differences dR, dG and 
dB of from R, G and B data of adjacent pixels have been 
determined beforehand. First, a variable, i, for 

10 representing a pixel is initialized to one (S1040) . The 
variable, i, has a value of 1, 2, n. Next, it is 

decided whether the input image data of i-th pixel satisfy 
following conditions of color range (S1041) . 
dRmin < dR ^ dRmax, 

15 dGmin < dG < dGmax, (2) 

and 

dBmin < dB < dBmax . 
Only if these conditions are satisfied, the pixel is 
decided to have a specified color, and it is decided as a 

20 specified dolor candidate (S1042) . The differences, dR, dG 
and dB, will be explained later. Further, as to the pixel, 
gradation differences of R, G and B data thereof from those 
of adjacent pixels existing in one direction are determined, 
and they are compared with predetermined threshold values 

25 in order to determine a position of edge in the direction 
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(51043) . This edge detection is performed in top, bottom, 
right, left and oblique directions. Next, i is incremented 

(51044) , and if the data processing have not yet been 
completed on all the pixels (NO at step S1045) , the flow 

5 returns to step S1042 to repeat the above-mentioned steps. 

Finally/ returning to Fig. 4, the decision 
results of the first and second decision means are 
subjected to AND operation for each pixel (S106) . That is, 
the pixel on which both of the first and second decision 

10 means decide to have the detection color candidate is 
decided to have the detection color. 

The second decision means is explained further 
with reference to Fig. 7. The pixels with hatching 
represent on-pixels. The adjacent pixels are 5*5 pixels 

15 around a target pixel. The maxima dR, dG and dB are 
gradation differences between the target pixel (designated 
with a star mark) and the adjacent pixels. If the 
differences dR, dG and dB between the maxima of R, G and G 
data of the adjacent pixels from R, G and B of the target 

20 pixel are in the above-mentioned ranges, the pixel is 
decided to be a detection color candidate- For example, if 
a pixel (designated with a triangular mark) has the largest 
R in the adjacent pixels and if the difference of the 
largest R from R of the target pixel exists in the above- 

25 mentioned range, the target pixel is decided as a detection 
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color candidate. Data G and B of the other colors are also 
subjected to the decision similarly. Only when the pixel is 
decided as a detection color candidate on all the data of R, 
G and B, it is decided as a detection color candidate. 
5 Though, in this example, the maximum of each of R, G and B 
data of the adjacent pixels is used for the decision. 
However, for example, the maximum of a sum of the R, G and B 
data may be used for the decision. 

An edge of a pattern can be discriminated 

10 correctly by deciding the differences of the color data 
• between a pixel and adjacent pixels thereof in different 
directions relative to the pixel (S1043 in Fig. 6) . 
Therefore, when small elements in the specified pattern are 
detected in the input image, an edge thereof can be 

15 extracted correctly. Because only the edge of the small 
element can be extracted, when a shape of the small element 
is detected, it is not liable to be affected by line width 
or the like. 

For example, in the example shown in Fig. 7, 
20 gradation differences relative to the target pixel (star 
mark) are determined based on the R, G and B data of 
adjacent pixels Al and A2 distant by one and two pixels in 
right direction. Then, an edge in right direction can be 
discriminated correctly. By processing similarly in top, 
2 5 bottom, left and oblique directions, an edge can be 
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discriminated correctly irrespective of the conditions of 
input image. Therefore, when only an edge is extracted, the 
position of an edge can be decided correctly by decision in 
various directions. 
5 An advantage of this embodiment is that 

differences due to deterioration of the scanner, change in 
environmental conditions and change in stress conditions 
can be decreased by taking gradation differences from 
adjacent pixels into account. Another advantage is that 

10 because only edges of small elements can be extracted, the 
detection of a shape of the small element is not liable to 
be affected by line width or the like. Further, the 
position of an edge can be discriminated correctly. 

Next, a second embodiment of the invention is 

15 explained. In the detection of a specified pattern, a 
specified pattern is detected in image data having a 
plurality of color data for each pixel received from an 
image input device such as the scanner 24. The detection 
of a specified pattern according to the second embodiment 

20 is the same as that according to the first embodiment 
explained above except the second decision means (SI 04 in 
Fig. 4) . When an image is read with the scanner 24, the 
color of the read image varies with scan conditions. 
Further, the image data are also affected by deterioration 

25 of the scanner, change in environmental conditions, change 
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in stress conditions or the like. Therefore, in order to 
detect a specified image, it is needed to widen the 
detection range of color. However, the widening of 
detection range is a factor which increases noises and 
5 detection errors. Then, in the second decision means in 
this embodiment, as will be explained below, in order to 
widen color detection range without increasing detection 
errors, ranges of results of linear operation such as (R-G) , 
(G-B) , (R-B), (R+G) , (G+B) and (R+B) are taken into account 

10 besides the values of lightness of R, G and B. 

In the flowchart shown in Fig. 4, it is decided 
by the second decision means whether the input image exists 
in detection ranges different from the above-mentioned 
relationships (1) (S104) . If only the maximum and minimum 

15 values of R, G and B are taken into account, a color 
clearly different from the detection color (hereinafter 
referred to as noise) may be detected. Then, in order to 
remove noises, a different condition is used. The 
condition mentioned below is an example. 

20 Fig. 8 is a flowchart of the second decision 

means (S104 in Fig. 4) . First, a variable i is reset to 
one for initialization (1046), wherein i has a value of 1, 
2, . n. Next, as to the input image data of i-th pixel, 
it is decided whether R-G, G-B and R-B satisfy following 

25 conditions (S1047) . 
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R - Rmin < Ri - Gi < R - Gmax, 

G - Brain < Gi - Bi < G - Bmax, (3.) 

and 

R - Bmin < Ri - Bi ^ R - Bmax. 
5 If these condition are not satisfied, the i-th pixel is 
deleted from the specified color candidates as noise 
(S1048) . Next, i is incremented (S1049), and if the data 
processing have not yet been completed on all the pixels 
(NO at step S1050) , the flow returns to step S1042 to 

10 repeat the above-mentioned steps. 

Then, an AND operation of the results of the 
first and second decision means is performed for each pixel 
(S106 in Fig. 4) . That is, a pixel decided as a detection 
color candidate both by the first and second decision means 

15 is decided to have the detection color. 

The second decision means is explained further . 
In an example, when yellow is detected in the R and G space 
as a specified color, as shown in Fig. 9, the maxima and 
minima are set as follows; Rmax = 255, Rmin = 150, Gmax = 

20 255, and Grain = 150. In the case of yellow (A), the image 
data are as follows: R - 255, G = 255 and B = 0. However, 
if only the conditions (1) are used, a color (A T ) of R = 
255 and G = 150 and another color (A") of R = 150 and G = 
255 are also detected as yellow. If the balance of R and G 

25 is changed, yellow moves towards red or green. Therefore, 
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when the balance of R and G is changed largely, it is 
desirable to detect it as a different color. Therefore, by 
using different conditions (3), the difference between R 
and G of the target pixel is limited within a certain value. 
5 Thus, noises such as A T and A" can be removed. 

In a modified example shown in Fig. 10, it is 
possible to set conditions on the ranges in detail. 
Instead of the second conditions (3) on the simple 
differences of image data, data of linear operation such as 

10 a sum or difference with use of coefficients for each image 
data (or more generally, a function of R, G and B) may be 
used to limit the detection ranges. In Fig. 10, the 
reference characters, a, b, c, d, e, f, g and h, denote 
coefficients for linear operations, and a dot area in Fig. 

15 10 represents the range for detection of specified color 
limited by linear operations of (a*R - b*G)max, (c*R - 
d*G)min, and the like. In Fig. 10, the conditions on the 
maxima and minima on the image data R, G themselves, that 
is, Rmax, Rmin, Gmax and Gmin. Though Fig. 10 shows only 

20 the R and G space, but similar conditions are set on the G 
and B space and on the R and B space. 

An advantage of this embodiment is that a 
specified color in a specified pattern can be detected even 
when the input image data are affected by deterioration of 

25 the scanner, change in environmental conditions, change in 
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stress conditions or the like. Another advantage of this 
embodiment is that errors in color detection can be 
decreased by narrowing the color detection ranges with use 
of different types of conditions, 
5 Although the present invention has been fully 

described in connection with the preferred embodiments 
thereof with reference to the accompanying drawings, it is 
to be noted that various changes and modifications are 
apparent to those skilled in the art. Such changes and 
10 modifications are to be understood as included within the 
scope of the present invention as defined by the appended 
claims unless they depart therefrom. 



